Accessible information in quantum measurement 
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The amount of information that can be accessed via measurement of a quantum system prepared 
in different states is limited by the Kholevo bound. We present a simple proof of this theorem 
and its extension to sequential measurements based on the properties of quantum conditional and 
mutual entropies. The proof relies on a minimal physical model of the measurement which does not 
assume environmental decoherence, and has an intuitive diagrammatic representation. 
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A fundamental issue of quantum information theory 
is the maximum amount of information that can be ex- 
tracted from a quantum system. Kholevo Q| proved that, 
if a system is prepared in a state described by one of the 
density operators pi [i = with probability pi, 

then the information / (defined in the sense of Shannon 
theory |2|) that can be gathered about the identity of the 
state never exceeds the so-called Kholevo bound 



I <S{ ^PrPi - ^PiS{pi) , 



(1) 



where S{p) = — Trplogp is the von Neumann entropy. 
This result holds for any measurement that can be per- 
formed on the system, including positive-operator- valued 
measures (POVM's). Since the original conjecture by 
Levitin |^ (proven by Kholevo work on this subject 
has been devoted to obtaining more rigorous proofs of the 
theorem, and to derivations of stronger upper or lower 
bounds on / |4|-|^. In this Letter, we start by revisiting 
the derivation proposed recently by Schumacher et al. |^] 
but in terms of a unified framework of quantum infor- 
mation theory which allows a more general formulation. 
Ref . Q is based on a physical model of quantum measure- 
ment and constitutes a notable improvement over earlier 
derivations which are less transparent, and that involve 
maximizing mutual Shannon entropies over all possible 
measurements. Here, we show that this proof can be 
considerably simplified by making use of quantum condi- 
tional and mutual entropies, and the constraints on them 
imposed by the unitarity of measurement [9|jlO|]. Also, 
the present formulation allows for a straightforward ex- 
tension of the Kholevo theorem to consecutive measure- 
ments. Such a treatment clarifies the physical content of 
the Kholevo theorem, which then simply states that the 
classical mutual entropy (i.e. the information acquired 
via measurement) is bounded from above by the quantum 
mutual entropy prior to measurement. More generally, 
we will show that 
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where S{X-y) = S{X) + S{Y) - S{XY) is the quan- 
tum mutual entropy between X and Y constructed from 
the density matrix pxY, while H{X:Y) is the Shannon 
mutual entropy ||ll| obtained from the joint probability 
distribution p(x, 2/ ) = {x,y\pxY\x,y) , where \x,y) is an 
arbitrary basis in the joint Hilbert space. The essence 
of the proof can be represented by simple arithmetic on 
quantum Venn diagrams, by making use of unitarity and 
strong subadditivity . In contrast to the derivation by 
Schumacher et al., no environment-induced decoherence 
is needed in the physical model of quantum measurement, 
while it can be added without difficulty. 

Let us assume that a "preparer" is described by a (dis- 
crete) internal variable X, distributed according to the 
probability distribution {i = \,---N). The internal 
state of the preparer, considered as a physical quantum 
system, is then given by the density matrix 



Px = y^^Pi\xi){xi 



(3) 



with the \xi) being an orthonormal set of preparer states. 
The state of the quantum variable X can be copied to 
another system simply by effecting conditional dynam- 
ics {e.g., a controUed-NOT quantum gate in a 2-state 
Hilbert space). In that sense, X behaves just like a clas- 
sical variable (it can be "cloned") and therefore refers 
to the macroscopic (collective) set of correlated internal 
variables of the preparer. Assume now that the preparer 
has at his disposal a set of N mixed states pi that can 
be put on a quantum channel Q according to his internal 
state (this is an operation which can be performed in a 
unitary manner). The joint state of the preparer and the 
quantum channel is then 



PXQ = '^Pi\^i){^i \ ® Pi 



(4) 



A partial trace over X simply gives the state of the quan- 
tum channel: 



H{X:Y) < S{X:Y) , 



(2) 



PQ = TrxpxQ = y^P^P^ 



(5) 
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The quantum entropy of X and Q is S{X) = H[pi] and 
S{Q) = S{p), while 

SiXQ) = H[p,]+Y,P^S{p^) , (6) 

i 

where the last expression results from the fact that pxQ 
is block-diagonal (this is the quantum analogue of the 
"grouping" property of Shannon entropies ) . The re- 
lation between these entropies is succinctly summarized 
by the quantum Venn diagram ^ in Fig. |l|. 

FIG. 1. Entropy Venn diagram for the correlated system 
XQ before measurement. 




First, let us write the quantum mutual entropy (or 
mutual entanglement) between X and Q before the mea- 
surement (see Fig. |l|): 

S{X:Q) - S{X) + S{Q) - S{XQ) 

= S{p)-J2p,Sip,) (7) 

i 

We see that S{X:Q) is just the Kholevo bound (the quan- 
tity denoted x^*^-* in Ref. Q). Thus, all we will need to 
prove is that the information extracted via measurement 
I < S{X:Q). Simple bounds for the mutual entangle- 
ment S{X:Q) can be obtained invoking the upper and 
lower bounds for the entropy of a convex combination of 
density matrices (see, e.g., Q). Using 

5^P.5(pO < S{p) < H[p,] + Y,p^S{p,) , (8) 

i i 

implies 

< S{X:Q) < H[p,] . (9) 

The upper bound in (^ guarantees that the entropy dia- 
gram for XQ represented in Fig. ^ has only non-negative 
entries and thus appears classical, a consequence of the 
fact that pxQ was constructed as a separable state. (Neg- 
ative values for conditional entropies betray quantum 
non-locality, see e.g. [pp^.) 



In the following, we describe the measurement of the 
preparation. This is achieved by bringing about a unitary 
operation on an ancilla A and the quantum preparation 
Q that effects entanglement, and subsequently observing 
the state of this ancilla. The information I extracted 
from the measurement is then just the mutual entropy 
between the ancilla and the preparer. Before interaction, 
the ancilla A is in a reference state |0) and the joint state 
of the system XQA is a product state pxQ ^ |0)(0|. This 
implies of course that S{X:Q) = S{X:QA), as A has van- 
ishing entropy. The joint system after interaction via a 
unitary transformation Uqa is described by 

px'Q'A' = {Ix Uqa){pxq ® |0)(0|)(lx UqaY (10) 

and the corresponding quantum Venn diagram Fig. 
(We denote by X', Q' , and A', the respective systems 
after measurement.) 

FIG. 2. Venn diagram summarizing the relation between 
entropies (defined in the text) after measurement in the sys- 
tem X'Q'A'. 




For the moment, let us assume that Uqa is arbitrary; 
we will discuss its specific form later. The key quan- 
tity of interest is the mutual entanglement S{X':A') be- 
tween the physical state of the ancilla A after measure- 
ment and the physical state of the preparer X (which 
has remained unchanged). We will show later that, with 
certain conditions on Uqa, S{X':A') is just the Shan- 
non mutual entropy between the preparer and the an- 
cilla, or, in other words, the information / extracted by 
the observer about the preparer state. Anticipating this, 
for a proof of Kholevo's theorem we need only find an 
upper bound for / — S{X':A'). As the measurement 
involves unitary evolution of QA while leaving X un- 
changed {X' = X), the mutual entanglement between X 
and QA is conserved: 

S{X':Q'A') = S{X:QA) = S{X:Q) . (11) 

We now split this entropy according to the quantum ana- 
logue of the chain rules for mutual entropies [[lOyi4| ] to 
obtain 

SiX'-.Q'A') = S{X':A') + SiX':Q'\A') (12) 
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where the second term on the right-hand side is a quan- 
tum conditional mutual entropy (the mutual entropy be- 
tween X' and Q', conditionally on A' , see Fig. I). Com- 
bining Eqs. ( [Tl| ) and (12), we find for the mutual entropy 
between ancilla and preparer after measurement 



S{X':A') = S{X:Q) - S{X':Q'\A') 



(13) 



This equation is represented as arithmetic on Venn di- 
agrams in Fig. ^. It indicates that the information ex- 
tracted is given by S{X:Q), the Kholevo bound Eq. (|), 
reduced by an amount which represents the quantum mu- 
tual entropy still existing between the preparer's internal 
variable X' and the quantum state after measurement 
Q' , conditional on the observed state of the ancilla A' . 

FIG. 3. Diagrammatic representation of the Kholevo theo- 
rem using the definitions given in Fig. ^. Thea area enclosed 
by the double solid lines represents the mutual entropy that 
is conserved in the measurement S{X' -.Q' A') = S{X:Q). 





The latter, the quantum conditional mutual entropy 
S{X':Q'\A') = S{X'A') + S{Q'A') - S{A') - SiX'Q'A') 
is in general difficult to estimate, and we may therefore 
make use of strong subadditivity fl^ to obtain an in- 
equality from Eq. (^) . Strong subadditivity implies that 
the conditional mutual entropy S{X:Y\Z) = S{X:YZ) - 
S{X:Z) between three quantum variables X, Y, and Z 
is non-negative. This expresses the physical idea that 
the mutual entanglement between X and YZ is larger or 
equal to the mutual entanglement between X and Z only 
(just as for mutual informations in Shannon theory), so 
that a mutual entanglement can never decrease when ex- 
tending a system. In particular we have S{X':Q'\A') > 0, 
which implies S{X':A') < S{X:Q). It remains to show 
that, for a particular Uqa which describes a measure- 
ment, the quantum mutual entropy S{Q':A') reduces to 
a Shannon mutual entropy or information, i.e., that in- 
deed S{X':A') = I. Let us focus on the case of a von 
Neumann measurement; using Neumark's theorem fl^ j 
it is easy to show that the same reasoning applies to any 
POVM. 

For the unitary evolution of a von Neumann measure- 
ment, we use the explicit form 



Uqa = ^Pa®Uc, 



(14) 



where the index a refers to the outcome of the measure- 
ment and the Pq's denote projectors in the Q space asso- 
ciated with the measurement (X)a = 1)- The unitary 



operators Ua act in the A space, and move the ancilla 
from the initial state |0) to a state \a) = Ua\0) that 
points to the outcome of the measurement. Let us as- 
sume that the \a) are orthogonal to make the outcomes 
perfectly distinguishable. The joint density matrix after 
unitary evolution is given by 



PX'Q'A' 



P^\Xi){x^\ ® PaPiPa' ® H {a' \ . (15) 



Now, according to the no-collapse model of the measure- 
ment introduced in ]lO[ | , we need to trace over the quan- 
tum system Q' which induces correlations between X' 
and A' . The corresponding density matrix is 



Px'A' = '^Pi^r{PaPi)\xi){xi\ (g> \a){a\ 



(16) 



As it is a diagonal matrix, the entropies of X', A' , and 
X'A' can be fully described within Shannon theory. (Our 
quantum definitions of conditional and mutual entropies 
reduce to the classical ones in this case |^.) A simple 
calculation shows that indeed 

S{X':A') = H [Tr(P„p)] ~ [Tr(P„p,)] (17) 

i 

^H{A)-H{A\X) = H{X:A) (18) 

where H stands for the Shannon entropy and l^v{PaPi) 
is the conditional probability Pa\i- This completes our 
derivation of the standard Kholevo theorem: 

/ = H{X:A) < S{X:Q) = S{p) - Y.p,S{p,) . (19) 

i 

The present derivation emphasizes that ignoring non- 
diagonal matrix elements in Eq. (^ results in a classi- 
cal density matrix (with diagonal elements pi^a = PiPa\i) 
whose Shannon mutual entropy is bounded from above 
by the corresponding quantum entropy. Inequality ( [l9| ) 
arises because some information about X might still be 
extractable from the system Q' after the measurement, 
i.e., S{X':Q'\A') > (this happens in an "incomplete" 
measurement). This does not mean, on the other hand, 
that if inequality (|l^) is not saturated, all of the re- 
maining entropy S{X':Q'\A') can necessarily be accessed 
through a subsequent measurement. Indeed, it is known 
that for non-commuting p^'s, the bound can newer be sat- 
urated, and better upper bounds on the accessible infor- 
mation have been propose d P J7[. In the picture that we 
have described, inequality (EM is fundamentally linked to 
the impossibility of producing a diagonal matrix px'Q'A' 
with a single Uqa which prevents S{X':Q'\A') from van- 
ishing for an ensemble of non-commuting pi. 

Note that the physical model of measurement used 
here [ pO[ is truly minimal: no environment is neces- 
sary a priori. If coupling to an environment E is used 
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in the description of measurement as in Q for diago- 
nalizing px'Q'A' (using decoherence as a means of se- 
lecting a "pointer basis" |J6|), part of the information 
may flow out to this environment. In a sense, E then 
plays the role of another ancilla and its state after mea- 
surement can still contain some additional information 
about X, i.e. S{X':E'\Q'A') could be non- vanishing. 
As the environment is by definition uncontrollable, this 
information can be considered to be irrecoverably lost: 
S{X' -.Q' A') < S{X:Q). As a consequence we obtain a 
bound [cf. Eq. ^] 

SiX':A') < S{X:Q) - SiX':Q'\A') . (20) 

The mutual conditional entropy S{X':Q'\A') can be cal- 
culated explicitly in the decoherence picture using the 
diagonal matrix 

PX'Q'A' =^Pi\Xi){Xi\(^PaPiPa®\a){a\ . (21) 



J2HiX:Aj\Ai---A,_i) < S{X:Q) 



(26) 



givmg 



S{X':Q'\^)=Y,^, 



^ {^Pi\aPodj ~^Pi\aSiPo 



(22) 

where pa = Tr(Pap), p^^ = PiPa\i/Pa, and pat = 
PaPiPa/Pa\i IS the density matrix obtained after mea- 
suring a on state pi. (The right hand side of Eq. ( |2^ ) is 

the quantity J2<,Pc^X^<?^ of Ref. g.) 

Let us consider now the extension of Kholevo's theo- 
rem to many sequential measurements. This is a gener- 
alization of the treatment of consecutive measurements 
of pure states that was presented in jlO|. To that effect, 
let m ancillae Ai, ■ ■ ■ , A^ interact successively with Q 
via unitary evolutions such as Eq. ( p^ ) with projectors 
Pai ■ ■ ■ Pa^ ■ The notation Aj corresponds to the j-th 
ancilla at time j or later (i.e., when the j first ancillae 
have interacted unitarily with Q). As previously, unitar- 
ity implies 



S{X^:Q^Ai - ■ ■ A,r^) = S{X:Q) 



(23) 



where X„i and Qm are the preparer and the quantum 
state after m interactions. Making use of 

S{X^:Q,nAi ■ ■ ■ A,„) = S{X,n:Ai ■ ■ ■ A„,) + 

5(X™ :Q„.|Ai---A„0 (24) 

we arrive at S{Xm'-Ai ■ ■ ■ Am) < S{X:Q). Argu- 
ing like before, ignoring the non-diagonal matrix ele- 
ments of pxAf-Am yields a Shannon mutual entropy 
H{X:Ai ■ ■ - Am) based on the conditional probabilities 

Tr(F„, •••P„„p,F„,„ (25) 



Pai- 



bounded by the corresponding quantum mutual entropy. 
Subsequently using the chain relations for classical en- 
tropies, we have the basic upper bound on the sum of 
accessible informations 



where iJ(X,„:Ai|0) = iJ(X„:Ai). Eq. (|6|) generahzes 
Kholevo's theorem and emphasizes that the outcome of 
every measurement is conditional on all previous out- 
comes. 



Finally, inequality (19) can be shown to be a special 
case of relation (^. Indeed, for a general density matrix 
pxY describing a bipartite quantum system whose com- 
ponents interact with ancillae A and B that define bases 
\x) and \y) respectively, we have S{A':B') = H{X-y), 
the Shannon mutual entropy of the joint probability 
Pxy = {x,y\pxY\x,y). Using 

S{X-y) = S{X'A':Y'B') 

= S{A':B') + S{A':Y'\B') + S{X' -.Y' B'\A') (27) 

and the non-negativity of conditional mutual entropies 
yields H{X:Y) < S{X:Y). 
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